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Abstract.  When  many  or  all  of  the  recipients  of  a  multi¬ 
cast  message  respond  to  the  multicast's  sender,  their  responses 
may  overflow  the  sender's  available  buffer  space.  Buffer  overflow 
is  a  serious,  known  problem  of  broadcast-based  protocols,  and 
can  be  troublesome  when  as  few  as  three  or  four  recipients 
respond.  We  develop  analytical  models  that  calculate  the 
expected  number  of  buffer  overflows  that  can  be  used  to  estimate 
the  number  of  buffers  necessary  for  an  application.  The  common 
cure  for  buffer  overflow  requires  that  recipients  delay  their 
responses  by  some  random  amount  of  time  in  order  to  increase 
the  minimum  spacing  between  response  messages,  eliminate  colli¬ 
sions  on  the  network,  and  decrease  the  peak  processing  demand 
at  the  sender.  In  our  table  driven  algorithm,  the  sender  tries  to 
minimize  the  multicast’ s  latency,  the  elapsed  time  between  its  ini¬ 
tial  transmission  of  the  multicast  and  its  reception  of  the  final 
response,  given  the  number  of  times  ( rounds )  it  is  willing  to 
retransmit  the  multicast.  It  includes  in  the  multicast  the  time 
interval  over  which  it  anticipates  receiving  the  response,  the 
round  timeout.  We  demonstrate  that  the  latency  of  single  round 
multicasts  exceeds  the  latency  of  multiple  round  multicasts.  We 
show  how  recipients  minimize  the  sender's  buffer  overflows  by 
independently  choosing  their  response  times  as  a  function  of  the 
round’ s  timeout,  sender's  buffer  size,  and  the  number  of  other 
recipients. 

1.  Introduction 

A  multicast  message  is  a  message  simultaneously  sent 
(broadcast)  to  a  group  of  recipients.  When  a  recipient  site 
receives  a  multicast  transmission,  it  formulates  and  forwards  its 
response  to  the  multicast’s  original  sender.  These  numerous, 
closely  spaced,  responses  may  overwhelm  the  multicast's  sender, 
causing  buffer  overflow  in  its  network  interface,  in  its  operating 
system,  or  in  its  outside-the-kemel  communication  protocol 
processes.  If  the  operating  system  implements  protocol  process¬ 
ing  in  the  user’s  address  space  [1],  responses  passing  through  the 
operating  system  may  overflow  buffers  in  the  user  process  that 
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initiated  the  multicast  because  this  is  swapped  out,  blocked,  or 
does  not  receive  adequate  processor  time.  We  illustrate  these 
overflow  points  in  Figure  1. 

Since  real  systems  have  finite  memory,  they  have  finite 
buffers.  However  most  finite  buffer  queueing  analyses  apply  only 
to  stationary,  homogeneous  arrival  processes;  little  work  exists  in 
the  analysis  of  finite  buffer  systems  [2]  [3]  [4]  with  non¬ 
stationary,  heterogeneous  arrival  processes.  Standard  blocking 
system  analyses  from  text  books  do  not  apply  to  this  problem 
because  they  deal  with  stationary  Poisson  and  stationary  general 
arrival  processes.  The  arrival  process  of  responses  to  a  multicast  is 
neither  stationary  nor  homogeneous.  It  is  not  homogeneous  since 
the  responses  come  from  both  fast  and  slow  machines;  it  is  not 
stationary  since  the  arrival  rate  decreases  as  responses  are 
received.  In  this  paper,  we  calculate  buffer  overflow  losses  due  to 
responses  from  multicast  transmissions.  Having  calculated  the 
number  and  distribution  of  losses,  we  describe  an  algorithm  that 
minimizes  the  time  to  receive  all  responses  to  a  multicast  given 
that  the  sender  is  willing  to  retransmit  a  certain  number  of  times. 
In  the  remainder  of  this  section  we  define  terminology,  present 
several  situations  for  which  multicast  is  appropriate,  and  describe 
our  model  of  the  network. 

We  say  the  sender  sends  a  multicast  to  the  recipients  and 
that  each  recipient  responds  with  its  response.  The  elapsed  time 


Figure  1.  Where  losses  may  occur. 
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between  the  instant  the  multicast  is  sent  and  the  instant  a 
recipient’s  response  is  received  is  the  recipient’s  response  time. 
The  probability  distribution  function  of  the  recipient’s  response 
time  is  the  response  time  distribution.  The  probability  distribu¬ 
tion  function  of  the  time  devoted  by  the  sender  to  process  a 
response  and  free  the  buffer  in  which  it  is  stored  is  the  sender’s 
service  time  distribution.  Additional  time  that  a  recipient  holds  its 
already  calculated  response  before  sending  it  to  the  sender  is  the 
recipient’s  backoff  time.  The  number  of  times  the  sender  rebroad¬ 
casts  the  message  is  the  number  of  multicast  rounds.  The  time 
window  associated  with  each  round  during  which  the  sender  col¬ 
lects  responses  is  the  round’s  timeout,  see  Figure  2.  We  treat 
responses  that  arrive  after  the  round’s  timeout  expires  as  losses 
during  that  round  and  assume  their  response  time  is  resampled  for 
each  subsequent  round.  The  elapsed  time  between  the  sender’s 
initial  transmission  of  the  multicast  and  its  receipt  of  the  last 
responses  is  the  multicast  latency.  We  do  not  measure  time  in 
seconds  or  in  milliseconds,  but  rather  treat  it  as  a  unitless  quantity. 
We  require,  however,  that  the  service  time  and  response  time  dis¬ 
tributions  be  expressed  in  identical  unit  systems. 

1.1.  Our  Model  of  the  Network 

The  analyses  in  the  following  sections  assume  (1)  the  net¬ 
work  is  unreliable,  and  some  sites  may  not  hear  transmissions 
received  at  other  sites;  (2)  except  where  noted,  the  network  is  oth¬ 
erwise  idle;  (3)  messages  do  not  collide  on  the  wire;  and  (4) 
except  where  noted,  messages  require  no  transmission  time. 
Equivalently,  assumptions  3  and  4  say  the  network  bandwidth  is 
infinite.  These  assumptions  make  our  analysis  possible,  and  tend 
to  overestimate  the  number  of  buffer  overflows  experienced  in 
practice  for  the  following  reasons.  Competing  network  traffic 
gives  the  sender  extra  time  to  service  its  buffers.  Ignoring  mes¬ 
sage  length  permits  responses  to  arrive  closer  together  than  physi¬ 
cally  permitted  by  the  network.  Ignoring  collisions  and  their 
prescribed  rescheduling  reduces  the  time  period  over  which  the 
responses  arrive.  Since  collisions  do  not  occur  on  ring  networks, 
these  analyses  perhaps  better  model  rings  than  CSMA/CD  net¬ 
works.  Finally  (5),  we  assume  that  all  recipients  of  a  multicast 
respond  to  the  sender  if  only  to  acknowledge  that  they  correctly 
received  the  message. 
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Figure  2.  Three  rounds  of  multicast 


1.2.  Why  Overflow  is  Important 

Speed  mismatches  at  the  interface  of  system  layers  cause 
buffer  overflow.  The  bit  rate  of  fiber  opuc  networks  exceeds  the 
rate  at  which  data  can  be  copied  into  most  computer’s  memory 
and  definitely  exceeds  the  rate  at  which  the  computer’s  protocol 
processing  runs.  These  speed  mismatches  will  always  exist. 
Although  various  proponents  of  broadcast-based  protocols  believe 
that  the  problem  of  buffer  overflows  is  solved  in  practice,  this  is 
not  true.  Let  us  review  their  arguments. 

Although  many  existing  network  interfaces  can  not  keep 
pace  with  the  network  and  possess  few  buffers,  some  argue  that 
interface  technology  is  improving  and  buffer  overflow  at  the  inter¬ 
face  will  not  be  a  problem  in  the  near  future.  While  true  for  the 
slow  Ethernet,  we  argue  that  as  interface  technology  advances, 
network  speeds  are  advancing  many  times  faster,  and  these  prob¬ 
lems  will  reappear.  FDDI,  a  100  MBit/Sec  ring  network,  exceeds 
the  the  memory  access  speed  of  most  existing  computers.  Since  a 
multicast’s  responses  come  from  many  computers  and  outstrips 
the  rate  at  which  a  single  computer  can  send  messages,  these 
responses  will  have  to  be  buffered  in  the  interface.  The  cost  of 
high  speed  buffer  memory  will  limit  the  buffer  size  within  these 
interfaces,  and  buffer  overflow  at  the  interface  will  again  be  a 
problem.  Regardless  of  network  speed,  the  various  computers  on  a 
network  will  always  have  disparate  speeds  and  buffering  capacity. 
Fast  computers  must  communicate  with  slow  computers.  Histor- 
icly,  interface  technology  lags  behind  the  introduction  of  new  net¬ 
works. 

Some  argue  that  the  number  of  acknowledgments  can  be 
reduced.  The  ordered  broadcast  algorithms  proposed  by  Chang 
and  Maxemchuk  [5]  eliminate  most  acknowledgements  because 
recipients  do  not  respond  to  the  sender.  The  number  of  ack¬ 
nowledgements  is  a  tunable  parameter.  However,  their  algorithms 
suffer  long  delivery  latency  times,  are  complex,  and  do  not  apply 
to  situations  where  the  recipients  must  respond  by  transmitting 
data  to  the  sender. 

Others  argue  that  acknowledgments  can  be  missed.  The  V 
kernel  deterministically  missed  two  out  of  four  and  one  out  of 
three  responses  [6],  Cheriton  says  this  is  not  a  problem  as  he 
needs  only  the  first  response,  but  not  everyone  needs  only  the  first, 
or  the  first  few  responses. 

We  must  understand  the  fundamental  statistics  behind 
buffer  overflow  to  address  the  problem  adequately,  wherever  it 
occurs.  Buffer  overflow  can  occur  within  the  operating  system 
and  protocol  processing  processes.  For  example,  the  Berkeley  4.3 
BSD  Unix  implementation  of  DARPA’s  TCP/IP  [7]  protocol 
devotes  only  4  kilobytes  (by  default)  to  protocol  buffer  space  [8], 
and  such  a  small  buffer  can  easily  overflow.  Throwing  memory  at 
the  problem  wastes  resources  and  may  not  be  possible  in  small 
systems  found,  for  example,  on  factory  floors. 

1J.  Previous  Work 

Although  many  distributed  systems  employ  broadcast  and 
broadcast-based  multicast,  researchers  have  lent  little  attention  to 
“backoff”  algorithms.  Gusella  and  Zatti  [9]  employed  backoff  to 
reduce  Ethernet  collisions.  Recipients  held  their  responses  for  an 
additional  random  delay  drawn  from  the  uniform  distribution  on 
some  interval.  Our  problems  differ  fundamentally.  We  minimize 
the  expected  time  to  collect  all  responses  to  a  multicast,  explicitly 
introducing  the  number  of  times  the  sender  may  retransmit  the 
multicast  The  system  designer  chooses  the  number  of 
broadcast-based  retransmissions  that  he  will  endure  (Additional 
broadcasts  extraneously  interrupt  those  recipients  that  have 


successfully  responded).  Knowing  this,  the  number  of  buffers 
available,  and  the  sender’s  service  time  distribution,  we  minimize 
the  expected  number  of  buffer  overflows  by  deriving  each  round's 
optimal  timeout  and  recipients’  optimal  common  arrival  time  dis¬ 
tribution.  Recipients  choose  their  backoff  functions  such  that  the 
combination  of  their  natural  response  time  distribution  and  back¬ 
off  time  function  is  distributed  with  this  optimal  distribution.  We 
assume  that  the  sender  includes  a  bit-map  of  successfully  ack¬ 
nowledged  sites  with  each  retransmission.  This  processes  can  be 
approximated  and  implemented  in  real  systems. 

1.4.  Outline  of  The  Paper 

In  Section  2,  we  consider  overflow  of  single  buffer  sys¬ 
tems.  This  illustrate  the  techniques  we  use  to  analyze  overflow  of 
multiple  buffer  systems  and  calculate  the  expected  number  of 
buffer  overflows  (back-to-back  message  loss)  of  single  buffer  sys¬ 
tems.  We  repeat  these  analyses  for  several  response  time  and 
buffer  service  time  distributions.  In  Section  3  we  derive  a 
dynamic  program  that  calculates  the  expected  number  of  overflow 
losses  for  multiple  buffer  systems  with  general  response  time  and 
exponential  buffer  service  time  distributions  and  for  exponential 
response  time  and  deterministic  service  time  distributions.  In 
Section  4,  we  pose  the  problem  of  finding  the  optimal  timeout, 
common  arrival  distribution  and  backoff  function  that  minimizes 
the  expected  number  of  buffer  overflows  during  a  round  of  multi¬ 
cast.  For  two  recipients,  exponential  buffer  service  time,  and  a 
one  buffer  system,  we  derive  the  exact  optimal  response  time  dis¬ 
tribution  that  minimizes  the  expected  number  of  losses  for  a  given 
round  timeout  We  apply  these  concepts  in  several  examples. 
Finally,  in  Section  5  we  review  our  findings  and  outline  our  future 
research  plans. 

2.  Buffer  Overflow  of  Single  Buffer  Systems 

The  number  of  buffer  overflows  depends  upon  the  recipient 
response  time  and  buffer  service  time  distributions.  We  restrict 
our  analysis  to  single  buffer  systems  in  this  section  because  they 
are  easier  to  analyze  than  multiple  buffer  systems,  and  because  we 
can  express  their  expected  number  of  buffer  overflows  in  closed 
form.  We  begin  with  the  analysis  of  systems  with  preassigned 
response  instants.  After  explaining  why  preassigned  response 
instants  are  impractical,  we  devote  the  rest  of  the  section  to 
analyzing  multicast  systems  with  independent,  identically  distri¬ 
buted  (i.i.d. )  response  time  distributions.  Single  buffer  systems 
suffer  overflow  if  the  interarrival  time  between  subsequent 
responses,  the  back-to-back  inter-message  time,  is  less  than  the 
buffer  service  time.  Borrowing  the  notation  of  queueing  theory, 
we  denote  a  multicast  to  N  recipients,  which  respond  with  com¬ 
mon  response  time  distribution  R ,  to  a  K-buffer  server  with  ser¬ 
vice  time  distribution  S ,  as  an  RN  /S /I IK  system. 

We  defer  the  analysis  of  exponential  response  time, 
exponential  buffer  service  time  distributions  to  Section  3,  the  dis¬ 
cussion  of  multiple  buffers  systems,  and  start  by  analyzing  con¬ 
stant  buffer  service  time  systems.  Constant  service  time  models 
network  interface  behavior  well.  The  time  to  move  a  message 
from  the  network  interface  to  the  operating  system  is  the  sum  of 
the  interrupt  service  latency  and  the  time  for  the  DMA  transfer 
between  interface  and  memory.  If  the  responses  are  of  equal  size, 
this  time  is  roughly  constant.  (Some  interfaces  do  not  buffer 
entire  messages,  buffering  a  few  bytes  at  a  time  in  a  FIFO 
instead.) 


2.1.  Preassigned  Response  Instants,  DN/M/1/1 

In  theory,  we  could  assign  a  response  instant  y,-  to  each 
recipient.  For  example,  we  could  assign  to  each  recipient  i,  a 
unique  instant  1 8  at  which  it  should  respond  to  the  multicast 
sender.  This  system  is  easily  modeled  as  its  interarrival  times  are 
constant.  If  the  buffer  service  time  is  exponentially  distributed 
with  mean  l/p,  then  the  expected  number  of  overflows  is  the 
expected  number  of  buffer  service  time  intervals  longer  than  5. 
Using  the  method  of  indicator  variables  introduced  below,  we  can 
show  that 

N 

E  [  Losses  ]  =  £  =  (N- 1)  e~*. 

j= 2 

If  the  buffer  service  time  is  a  constant  (1,  no  overflow 
occurs  when  8  >  (1.  Although  preassigning  response  instants  exhi¬ 
bits  few  losses,  it  requires  mam  taming  a  group  list,  requires  accu¬ 
rate  deadline  scheduling,  assumes  that  all  recipients  can  calculate 
their  responses  before  their  mandated  response  instant  expires, 
and  can  be  unnecessarily  slow  when  we  do  not  require  that  all 
recipients  respond.  To  illustrate  this  last  point,  consider  the  prob¬ 
lem  of  finding  a  lightly-loaded  site  for  balancing.  Theimer  [10] 
suggests  that  sites  schedule  their  responses  proportionally  to  their 
loads  and  not  respond  at  all  if  they  are  unwilling  to  accept  more 
jobs.  Assigned  response  instants  increase  the  expected  time  to 
receive  a  small  number  of  responses,  and  is  too  rigid  of  a  policy. 
We  will  consider  i.i.d.  random,  response  time  distributions  for  the 
remainder  of  this  section. 

2.2.  Upper  Bound  for  MN/D/1/1  Systems 

Each  recipient  i  responds  at  instant  yf  independently  of 
other  recipients,  where  y;  is  drawn  from  the  exponential  distribu¬ 
tion  with  mean  1/A, 

Pr(yi  <t  )  =  F(t)  =  1  -e~x‘ . 

We  employ  order  statistics  [11]  to  calculate  the  expected 
number  of  buffer  overflows. 

Briefly,  the  order  statistics  y (]>,  y(2), ....  y(N)  of  N  i.i.d.  ran¬ 
dom  variables  y  i,  y  2,  ....  y«  are  the  y; ’s  sorted  in  increasing  order. 
That  is 

>a><y(2)<  •••  <ym- 

The  joint  distribution  of  the  order  statistics  of  N  i.i.d.  con¬ 
tinuous  random  variables  is 

«  n/Cy.)  • 

i=l 

If  1/iVA,  the  initial  expected  interresponse  time,  is  not 
significantly  larger  than  the  constant  buffer  service  time  (3, 
responses  arrive  closely  spaced  and  easily  overflow  the  buffer. 
The  expected  time  to  receive  all  N  responses  is  the  expected  value 
of  the  slowest  of  the  N  independent  response  instants, 

£[y(W)]  =  A.-1  (i+2-1+...+/v-1), 

the  maximum  of  N  i.i.d. ,  exponentially  distributed  random  vari¬ 
ables. 

Recall  that  the  sum  of  exponentially  distributed  random 
variables  is  itself  exponentially  distributed  with  rate  equal  to  the 
sum  of  the  individual  rates.  Immediately  after  the  multicast,  but 
before  any  recipient  responds,  the  responses  arrive  at  rate  NX. 
After  the  first  response,  this  drops  to  (ZV-l)A,  and  each 


subsequent  response  decreases  the  future  arrival  rate  by  X. 

Since  responses  require  buffer  service  time  (3,  the  buffer 
overflows  if  any  interarrival  interval  is  shorter  than  (3.  The  proba¬ 
bility  <£>  that  no  two  responses  arrive  within  time  (3,  that  is  the  pro¬ 
bability  that  no  responses  are  lost,  is  the  product  of  the  probabili¬ 
ties  that  all  iV-1  interramval  times  exceed  {3.  Since  y(i  + arrives 
with  rate  (N-i  )X,  the  probability  that  the  interval  between  y(i)  and 
y(i+D  exceeds  the  service  time  |3  is 

/’'•[y;+1-y,>p]  =  (1) 

The  probability  4>  then  is  the  product  of  the  probabilities  that  all 
interarrival  intervals  exceed  {3, 

N-l  -axT; 

$>=Yle^iX  =  e  m  =e-^N(n -i)i2 
;'=t 


We  discover  that  the  mean  response  time  1/A.  must  grow 
quadratically  with  N  to  achieve  a  small  probability  of  overflow. 

The  expected  number  of  interarrival  intervals  shorter  than 
(3  bounds  the  expected  number  of  buffer  overflows.  We  employ 
the  method  of  indicator  variables  to  derive  this  upper  bound, 
which  is  a  more  convenient  expression  than  the  exact  number  of 
overflows  calculated  later  in  this  section. 

Let  the  indicator  variable  It  ((3)  be 


/,( P)  = 


f  i  ( y  <f+D  —  >(.-))  ^  P. 

0  otherwise. 


(2) 


The  expected  number  of  short  intervals  is 

e [*£  /, (P)]  =  2  e [7, (p)]  =  2  Pr [  J<M> - ym *  p]. 


The  probability  that  (y(i+1)  —  >(,’))  -  P  given  by  (1).  The 
expected  number  of  short  intervals  bounds  the  expected  number 
of  overflow  losses,  and  grows  tighter  with  decreasing  expected 
number  of  overflows.  Keep  in  mind  that  the  exponential 
distribution’s  weight  extends  to  infinity,  an  infinite  horizon,  and 
additional  losses  are  possible  for  responses  that  arrive  after  the 
round’s  timeout  expires.  The  expected  number  of  losses  is 
bounded  above  by 

E [Losses]  5  £[2  /. (P)]  =  2  d  ~  ) 

•'=i  i= t 


<N-1- 


e-(0._e-SNX 

1-e-K 


(3) 


The  probability  of  no  buffer  overflow,  <b,  equals  the  proba¬ 
bility  that  all  N-l  interarrival  intervals  exceed  P,  and  can  be 
found  by  evaluating  the  integral1 

T -N&  t 

$=jT  {  J  •••  J  dyN  -dy  J  . 

v  a  j»;+p 

The  first  integral  corresponds  to  the  arrival  time  of  the  first 
response.  The  lower  limit  of  each  subsequent  integral  is  p  greater 
than  its  predecessor.  This  represents  the  constraint  that  each 
interarrival  period  exceed  p.  Integrating  yields 


N 


*=2 

i=0 


N 

(£)'(N- 1)'(-1)‘  = 

1  —  (N  -  1)  — 

l 

T 

T 

N 


(4) 


We  have  calculated  the  probability  <£>  of  no  overflow  loss 
given  the  response  time  is  uniformly  distributed  on  (0,  x). 
Employing  indicator  variable  /,•  (p),  defined  in  (2),  we  can  bound 
the  expected  number  of  responses  lost  to  buffer  overflow  by  the 
expected  number  of  interarrival  intervals  shorter  than  p. 

E[2  /<(P)]  =  2  E[/.(P)]=  2  Pr[yv^-ym  <  P  ].  (5) 

i=t  i=t  i=t 

Each  term  in  summation  (5)  corresponds  to  an  integral  similar  to 
the  one  shown  below,  and  it  turns  out  that  these  integrals  are 
identical.  The  integral  corresponding  to  the  summation’s  last 
term  is 

v-p  t-P  t-P  t 

1-TT  J  /  J  j  dyN  -dy  1.  (6) 

Substituting  (6)  into  (5)  and  adding  up  terms,  we  find  the  expected 
number  of  closely  spaced  responses,  an  upper  bound  on  the 
number  of  losses,  is 

E[Iosses]  <  (N  —  1)  (1  —  2  (-I)1'  (|)') 

<(w-i)(i-(i-|n  (7) 

We  employed  order  statistics  to  arrive  at  the  probabilities  the 
interrarrival  interval  exceeds  p.  However  there  exists  an  elegant 
proof  which  yields  the  same.  Place  n+ 1  points  uniformly  on  the 
circle  with  circumference  x.  Cut  the  circle  at  one  of  these  points 
and  label  one  end  0  and  the  other  t.  From  symmetry  arguments, 
one  arrives  at  (7). 


2.3.  Upper  Bound  for  UN/D/1/1  Systems 

In  this  case,  each  recipient  i  responds  at  instant  y;  drawn 
independently  from  the  uniform  distribution  on  the  interval  (0,  x). 
The  expected  time  to  receive  all  N  responses  is  the  expected  value 
of  the  N’1'  order  statistic  yW), 

N  x 

n  +  r 

The  probability  density  function  of  the  order  statistics  of  N  uni¬ 
formly  distributed  random  variables  is 

N\ 

f(ya)<y  (2).  -.>(«)  )= 


3.  Overflowing  Multiple  Buffers 

We  begin  this  section  multiple  buffer  systems  by  finding 
the  expected  number  of  overflows  when  both  the  recipient 
response  time  and  the  sender’s  buffer  service  time  are  distributed 
exponentially,  MN  /MlVb.  Next  we  develop  a  dynamic  program 
that  calculates  overflow  losses  for  a  general  i.i.d.  response  time 
distribution  with  an  exponentially  distributed  buffer  service  time, 
Gn IMIllb.  Finally,  we  apply  this  program  when  the  recipient’s 
response  time  distribution  is  uniform,  UN /Mll/b . 

Figure  3  plots  the  number  of  overflows  for  various 
numbers  of  recipients,  numbers  of  buffers,  and  response  time 


1  This  problem  appears  in  volume  2  of  [12]  as  problem  24,  Section 


1.13. 


distributions  of  equal  expected  completion  time  y^y  Notice  how 
the  response  time  distribution  significantly  affects  the  expected 
number  of  losses.  This  effect  increases  with  the  number  of 
buffers.  We  devote  this  section  to  deriving  expressions  that  accu¬ 
rately  predict  this  behavior. 

3.1.  Preassigned  Response  Instants,  DN/M/l/b 

Assign  to  each  recipient  a  unique  time  fS  at  which  it 
schedules  its  response.  We  calculate  the  expected  number  of 
losses  by  observing  that  a  loss  occurs  if  all  6  buffers  are  occupied 
when  a  recipient  responds.  Define  L„  (s )  as  the  expected  number 
of  losses  when  n  recipients  respond,  s  buffers  begin  occupied,  and 
the  first  of  the  n  responses  arrives  immediately. 

J+1 

Ln(s)=  X  Ln-l(s  +  l~i)  P,+U 
1=0 

Ln{b)=\  +  Y,U-x{b-i)Ph4 

i=0 


3.2.  MN/M/l/b  Systems 

The  problem  of  finding  the  number  of  buffer  overflows 
given  both  exponential  response  and  senfice  time  distributions  is 
relatively  easy  and  can  be  solved  in  numerous  ways.  We  begin  by 
drawing  a  two-dimensional  Markov  chain,  where  state  (i  ,j ) 
means  i  responses  are  outstanding  and  j  buffers  are  full  (see  Fig¬ 
ure  4).  When  6=1,  we  can  write  the  expression  for  the  expected 
number  of  buffer  overflows  by  inspection. 

*-i  i  X 

E [losses]  =  2  ■ 

P  n+A 

Alternatively,  we  can  write  a  fast  dynamic  program  [13]  to  count 
the  expected  number  of  buffer  overflows. 

L,(0)=L._1(1)  (8) 

(s)  =  P  n-JLs-i(,s+ 1)  +  (1  —P  )Ln(s— 1) 

Ln  (6 )  =  P„>(1  +  Ln.  i(6  ))  +  (1  -Pnj)LN  (6-1) 


Pij  -  (ji.8)'  e~iv-li\ 

Pu-1-i.Pij 

j=o 


In  these  equations,  we  sum  over  i ,  the  number  of  buffers 
that  are  emptied  during  time  8  before  the  next  response  arrives. 
When  the  next  arrival  occurs,  s+l-t  buffers  are  full,  1  for  this 
arrival,  s-i  for  the  previously  buffered  arrivals  that  were  not 
served  in  the  interim.  The  probability  that  i ,  i  <  s  +  1,  of  the  full 
buffers  are  emptied  is  simply  the  probability  that  i  Poisson- 
distributed  events  occur  during  time  8.  The  probability  that  all 
s+1  are  emptied  is  the  probability  that  non  of  the  events  i  is 
occur. 


Mean  Buffer  Service  Tune 


p  _  nX 
n,i  nX.+  Uo(s)p. 

where  u0  is  the  unit  step  function. 

This  program  can  be  quickly  calculated  bottom  up.  In  the  next 
section  we  present  a  brute  force  technique  that  yields  an  exact 
solution  for  general  response  time  distributions. 


3d?.  GN/M/l/b  Systems 

The  dynamic  program  below  finds  the  number  of  buffer 
overflows  suffered  by  multiple  buffer,  general  response  time, 
exponential  service  time  systems.  The  calculation  is  reminiscent 
of  G/M/l/b  loss  system  analysis  of  classical  queueing  theory. 
Let  Ln  (s,  / )  be  the  expected  number  of  overflows  given  that  s  of 
the  6  buffers  start  full,  the  last  arrival  occurred  at  time  t ,  and  n 
additional  arrivals  remain  outstanding.  Ln(s,t)  is  an  integral 
over  the  arrival  time,  x ,  of  the  next  arrival.  Since  all  arrivals  are 
drawn  from  a  common  response  time  distribution,  we  can  easily 
express  the  probability  density  function,  /„ ,  of  the  next  arrival. 

The  probability  distribution  function  of  each  of  the  remain¬ 
ing  n  responses,  conditioned  on  the  arrival  time  t  of  the  last 
arrival,  F  (y  I  y  >  t ),  is 


Pr(y-x  'y>t)=fp£To 

Similarly, 


F(x) 

1  ~F(t)  ■ 


Pr(y  >x  I  y  >t)  = 


P(y  >x  )  _  1  - F (x ) 
P(y  >t)  l-F(f)  ' 


The  probability  density  function  of  the  next  arrival  is  then  the  pro¬ 
duct  of  this  density  and  the  probability  that  the  remaining  n— 1 
responses  arrive  later,  all  multiplied  by  n ,  the  number  of  ways  to 
select  the  first  arrival. 


fn{x)-n 


1-F(*)j fix) 

1  ~F(t)  1  -F(t) 


Figure  3.  Multiple  Buffer  Overflow  for 
(N,b)={(200,5),(200,10)  ).  MNIM/Vb  and  UN/M/Vb 
systems. 


We  now  unveil  the  recursive  expression  for  the  expected 
number  of  overflows,  Ln(s,t). 


Figure  4.  Markov  chain  that  corresponds  to  the  AfM/M /1/3 
system. 


given  the  s  +  1  —  i  buffers  are  occupied.  The  number  s  +  1  -  i 
proceeds  from  the  s  buffers  previously  occupied,  one  more  for  the 
new  arrival,  less  the  i  puffers  that  were  served  during  time  x  that 
no  responses  arrived. 

When  all  b  buffers  are  full,  then  a  loss  occurs  with  proba¬ 
bility  ph  o,  the  probability  that  no  buffers  are  emptied  before  the 
next  response  arrives.  Although  formidable  in  appearance,  we  can 
integrate  expression  (9)  in  polynomial  time.  For  example,  we 
now  apply  (9)  to  the  case  of  uniformly  distributed  response  times. 


3.4.  UN/M/l/b  Systems 

We  can  more  easily  calculate  the  solution  to  dynamic  pro¬ 
gram  (9)  for  uniformly  distributed  response  times  than  for  any 
other  response  time  distribution.  Exploiting  the  fact  that  the 
arrival  distribution  of  the  remaining  responses  is  also  uniform 
when  it  is  conditioned  on  knowing  the  arrival  instant  of  the  most 
recent  response,  we  redefine  Ln  (  s ,  t )  to  be  the  expected  number 
of  losses  when  n  responses  remain  outstanding  given  that  s 
buffers  start  full  and  the  remaining  responses  arrive  uniformly  on 
(0,0. 


Lm(s.t)  = 


t 

r 

•  * 

n  f 

t  -x 

rl 

t 

(10) 


s 

2)L._1(s-i+l  ,t-x)psj(x) 

i=0 


dx 


b 

'£L.-1(b-i+l  ,t-x)p,  ,(.x) 
1=1 


+  (l+£.~i(&.f-*)Pt.,o(*))  dx 


For  single  buffer  systems  with  uniform  responses  on  (0,  T), 
this  dynamic  programs  yields  the  closed  form  solution 


Ln  ( S,t)  = 


(9) 


a 

J/»(*)  'ZLn-d  s+l-i ,  x)  p,<.u(x -t)  dx. 

t  1=0 


n!(n— 1)-|  (ptT)-1  £  OiT)-(-l)*'/(n-l-t)! 
i=0 


+ 


(-1 T  e-v 


Ln  ( 6.0  = 


J  /«(*)£[  Ln-l(b+l-i,x)pbj(x  -o] 
/  1=1  ^  J 

(Ln-i(b,x)+  l)pMj  dx 


Although  closed  form  solutions  for  arbitrary  numbers  of 
buffers  (b*l,b#N  —  1)  are  not  possible,  we  can  always 
integrate  (10).  For  example,  exptected  overflow  losses  for  N= 4 
recipients  that  arrive  cm  (0, 1)  and  with  a  b-buffer  system  are 
given  by 

6=1:  1 2((ji~1-3n~2+6pr3-6pT*)  +  e~»  (6fO). 


L0(s,  0  =  0. 


/>»..•(*)  H 


(n xfe-^rn 

j-1 

k= 0 


i  <st 
i=s. 


b=  2:  1 2((2|i*2-6|x_344^.~4) 

+  e ((3\L)-l+2\i2+2\i-3-4\i^)). 
b=  3:  \2((2[L'3-6\i'4)  +  e~»  (MT2^-3+6p^). 


The  sums  are  over  the  number  of  buffers  serviced  before  the  next 
respxmse  arrives  at  time  x .  We  sum  the  exp>ected  number  of 
overflows  that  occur  when  the  remaining  n-1  responses  arrive 


Although  the  uniform  respxmse  time  distribution  suffers 
fewer  exprected  losses  than  the  expxmential  distribution,  it  does  not 
minimize  buffer  overflow.  Finding  the  optimal,  i.i.d.  respxmse 
time  distribution  that  minimizes  the  number  of  buffer  overflows 


depends  on  the  service  distribution,  the  number  of  buffers,  the 
number  of  responses,  and  the  number  of  buffers  that  start  full. 
We  consider  this  problem  in  Section  4. 

4.  Finding  the  Backoff  Algorithm  and  Round  Timeouts 

In  many  situations,  all  the  recipients  calculate  and  transmit 
their  responses  to  the  sender  within  a  brief  time  of  each  other,  and 
the  sender  loses  some  or  many  of  these  responses,  and  must 
request  that  certain  sites  repeat  their  responses.  Demanding  that 
each  recipient  delay  its  response  for  some  random  time  alleviates 
the  buffer  overflow.  We  call  this  delay  recipient  backoff ,  and,  in 
this  section,  construct  an  optimal  backoff  algorithm  based  on  each 
recipient’s  measured  response  time  distribution.  Our  algorithm 
suffers  the  fewest  possible  expected  number  of  overflows,  given 
that  all  recipients  must  respond  before  the  round's  timeout 
expires.  We  employ  the  backoff  algorithm  to  minimize  our 
multicast’s  cost  metric,  a  linear,  weighted  sum  of  the  number  of 
broadcasts,  number  of  responses,  and  overall  elapsed  time 
(latency).  Alternatively,  the  sender  can  choose  the  number  of 
broadcast-based  rounds  beforehand,  and  calculate  each  round's 
timeout  immediately  prior  to  broadcasting  the  round,  so  as  to 
minimize  the  overall  latency. 

Finding  the  i.i.d.  arrival  time  distribution  that  minimizes 
buffer  overflow,  given  the  number  of  recipients,  number  of 
buffers,  round  timeout,  and  buffer  service  distribution,  we  believe, 
is  an  unsolved  problem.  We  call  this  the  Dynasty  Problem 2  and 
begin  by  solving  it  for  two  recipients,  one  buffer,  and  exponential 
buffer  service  time  distribution.  We  note  that  its  solution  is  com¬ 
posed  of  a  uniform  and  a  bimodal  distribution,  and  our  simulation 
study  suggests  that  such  a  distribution  is  optimal  for  any  number 
of  recipients  and  buffers. 

4.1.  Optimal  Response  Time  Distribution,  Two  Responses, 
One  Buffer 

Consider  the  problem  of  finding  the  common  i.i.d. 
response  time  density  h  (y ),  0  <  y  <1,  that  minimizes  the  number 
of  overflows  of  a  single  buffer  server  when  there  are  two 
responses,  and  buffer  service  time  is  exponentially  distributed 
with  mean  l/|i.  Or  equivalently,  find  the  common  i.i.d  response 
time  density  that  minimizes  the  probability  that  the  first  response 
is  still  in  service  when  the  second  arrives.  If  it  is,  the  second 
response  overflows  the  buffer,  otherwise  it  does  not. 

The  expected  number  of  overflows,  or  this  probability,  is 

t  t 

2^e-^-y^h(y2)h(yl)dy2dy1  (11) 

constrained  by  the  equations  that  make  h  ( y )  a  probability  density 
function 


second  derivatives,  a  requirement  for  that  technique.  Instead,  we 
transform  (11)  into  a  discrete  optimization  problem  by  subdivid¬ 
ing  (0, 1)  into  M  identical  subintervals,  and  apply  the  method  of 
Lagrange  multipliers  [15]  to  find  the  optimal,  discrete  distribution. 

Denote  the  number  of  losses  by  L  (p). 

U P)  =  ^Pi2  +  2Z  £  PtPie-V-0*"  ■ 

1=1  »=i  y*»+i 

We  introduce  Lagrange  multipliers  to  incorporate  the  constraint 
equations. 

/(p,a.)=L(P)  +  X((f»-i). 

i=i 


Vp  /  (p,X)  =  0  . 


Vx/(p,X)  =  0. 


We  solve  this  system  of  M  +  1  linear  equations  for  the  discrete 
solution  p.  The  endpoint  probabilities  pi  and  pu  are  equal,  and 
the  interior-point  probabilities  are  equal. 

eWK 

Pl=Pu  =  N(e^-l)  +  2’ 


P 2  ’  M(e^M -1)  +  2 

Taking  the  limit  as  integer  M  becomes  large  and  substituting 
(1+p/Af  )  for  e1"1*,  we  find  the  weight  at  the  interval’s  endpoints 
is  conserved 


P\-Pm  - 


p+2  ’ 


and  the  probability  density  of  the  interior  points  remains  uniform. 
The  optimal  i.i.d  continuous  density  function  is 


h(y)  = 


SQO  +  jt  +  Sfl— y) 

[t+2 


(12) 


where  5(y )  is  the  Dirac  delta  function. 


We  see  h  (y )  is  the  superposition  of  a  uniform  distribution 
and  two  impulses,  one  at  either  endpoint.  As  the  mean  service 
time  1/|I  decreases,  the  optimal  distribution  approaches  the  uni¬ 
form  distribution.  As  the  mean  service  time  increases,  the  optimal 
distribution  approaches  the  bimodal  distribution  with  equal  weight 
of  one  half  at  the  interval’s  endpoints  0  and  1 . 

We  find  the  expected  number  of  losses  by  carrying  out 
integral  (11),  substituting  (12)  for  h  (y ), 


E  [losses  ]  = 


2 

2+|i 


t  t 

2  JJ  h(y£  h(yt)  dy  i  dy  , 

Oy, 

and 

h(y)>  0,  0<y  <1  . 

Although  this  appears  solvable  by  the  calculus  of  variations  [14], 
the  optimal  distribution  h  ( y  )  does  not  have  continuous  first  and 


2 The  name  Dynasty  recognizes  a  Berkeley  restaurant,  dubiously 
honored  with  the  city’s  worst  health  inspection  record. 


We  plot  the  expected  number  of  losses  for  the  optimal  distribution 
(12),  the  uniform  distribution,  and  the  bimodal  distribution  with 
probability  one  half  at  each  end  point  in  Figure  5. 

The  bimodal  arrival  distribution  always  outperforms  the 
uniform  arrival  distribution  [17],  showing  more  improvement  as 
the  number  of  recipients  approaches  the  number  of  buffers. 
Assume  we  knew  the  optimal  arrival  distribution  on  an  interval 
(0,  T).  If  we  found  a  backoff  algorithm  that  mapped  each  site’s 
measured  response  time  distribution  into  the  optimal  response 
time  distribution,  then  we  would  minimize  buffer  overflow. 


3  A  different  problem  is  solved  in  [16]  using  similar  methods. 


Service  Rale  p. 

Figure  5.  Losses  versus  response  time  distribution  for  2 

responses,  exponential  buffer  service,  and  one  buffer. 

4.2.  Our  Backoff  Algorithm 

Since  the  recipients’  response  time  distributions  are  neither 
identical  to  one  another,  nor  equal  to  some  well  characterized  dis¬ 
tribution,  they  must  be  individually  measured.  Denote  recipient 
i’s  measured  response  time  distribution  by  F;  and  its  site- 
dependent  backoff  algorithm  by  G(.  Denote  recipient  t’s 
observed  response  time  to  the  multicast  by  y; ,  and,  finally,  assume 
the  optimal  arrival  distribution  that  minimizes  buffer  overflow 
given  N  recipients,  round  timeout  x,  and  b  buffers  is  known,  and 
denoted  by  H(  N,  b,  x).  In  this  section  we  construct  an  optimal, 
backoff  function  G,-  =  G,(  F,-,  x,  y.)  that  minimizes  the  expected 
number  of  buffer  overflows.  In  the  next  section  we  show  how  to 
select  the  round’s  timeout  x. 

We  want  a  backoff  function  G»  such  that,  when  added  to 
the  site’s  response  time  y,-,  it  transforms  the  site’s  response  time 
distribution  F;  into  the  optimal  arrival  distribution  H.  If  y( 
exceeds  x  then  the  response  y;  becomes  ready  during  some  subse¬ 
quent  round  of  multicast,  and  we  delay  it  no  further.  In  real  sys¬ 
tems  late  responses  may  be  processed;  here,  we  consider  them 
lost.  We  construct  our  site  specific  backoff  function  G,-  as  fol¬ 
lows.  It  is  the  time  difference  between  the  optimal  distribution  and 
the  response  time  distribution  corresponding  to  the  observed 
response  time.  We  defer  considering  response  time  distributions 
F,  that  lie  beneath  H  (contrast  Figure  6  and  Figure  8)  until  later  in 
the  section. 

G;  =//“'(  F,(y,)  )  -  y,-. 


We  want  to  map  Fj,  exponentially  distributed  with  param¬ 
eter  K  onto  the  uniform  distribution  on  (0,  x).  Since  the  exponen¬ 
tial  distribution’s  tail  is  infinitely  long,  some  responses  may  arrive 
after  the  round’s  timeout  x  expires.  Assume  such  responses  are 
lost.  However,  every  response  that  arrives  before  x  appears  to 
arrive  uniformly  on  (0,  x).  Applying  equation  (13),  the  backoff 
function  is 

t  n  -  e  -*•>"  1 

G1(y:)  =  max(  — - - °>- 

1  -  e 

We  want  to  map  F 2,  uniformly  distributed  on  (0,  b ),  onto 
the  uniform  distribution  on  (0,  x).  G2  depends  on  whether  the  b 
exceeds  or  falls  short  of  x.  If  b  exceeds  x,  we  assume  responses 
that  arrive  after  the  round’s  timeout  x  expires  are  lost,  and  we  do 
not  further  delay  them. 

Jo  if  b  >  x, 

^■2^2)- y2(x  —  b)/b  otherwise. 

If  some  third  site  exhibited  an  instantaneous  response  time, 
F3,  then  the  backoff  function  would  simply  be  a  uniformly  distri¬ 
buted  random  variable. 

G3(y  3)  =  uniform  (0,  x  )  . 

This  foreshadows  the  section  on  discontinuous  response  time  dis¬ 
tributions.  If  any  F,-  contains  a  discontinuous  jump,  then  G;  maps 
this  jump  onto  a  uniformly  distributed  random  backoff  time  of  an 
appropriate  duration. 


Suppose  the  optimal  arrival  distribution  were  uniform  and 
the  service  time  distributions  F,-  lie  above  it.  The  equation  below 
would  give  the  site  specific  backoff  functions. 

/-  /  \  /  y*  Fiiyi)  ns  /n\ 

G,  (y,  )  =  mox(  ,  0).  (13) 

In  Figure  6  we  plot  probability  distribution  functions  H  (supposed 
uniform),  F 1  (an  exponential),  and  F2  (another  uniform),  and  the 
backoff  functions  for  site  one  and  two,  G  3  and  G2. 


43.  Selecting  a  Round’s  Timeout 

The  problem  of  selecting  a  round’s  timeout  is  related  to  the 
problem  of  detecting  failed  sites,  mentioned  earlier.  Recall  that 
the  sender  determines  that  a  site  has  failed  if  it  fails  to  respond  to 
several  transmissions.  Existing  protocols  attempt  4  or  5 
retransmissions  with  timeouts  either  determined  by  binary- 
exponential  backoff  or  simply  set  to  a  few  seconds,  or  tens  of 
seconds.  If  a  recipient  fails  no  respond  after  all  of  these  attempts 
pass,  the  sender  assumes  it  has  failed.  On  one  hand,  if  we  set  the 


timeouts  too  short,  each  round  results  in  many  buffer  overflows, 
and  5  rounds  may  be  insufficient  to  determine  site  failure.  On  the 
other  hand,  if  we  set  the  timeouts  too  lqng,  we  needlessly  increase 
the  multicast’s  latency.  Selecting  timeouts  poses  difficult  optimi¬ 
zation  problems,  which  we  illustrate  with  several  examples. 
Let’s  assume  that  recipients  respond  uniformly  on  a  prescribed 
interval. 

Example.  UJ0/D/1/1,  Two  Rounds. 

Consider  a  two-round  multicast.  We  want  to  minimize  the 
latency,  Tt  +  x2,  such  that  after  the  second  round,  the  probability 
that  one  or  more  responses  remain  outstanding  due  to  buffer 
overflow  is  less  than  e.  We  permit  the  second  round  timeout  to 
depend  on  the  number  of  overflows  experienced  during  the  first 
round.  We  must  solve  the  optimization  problem 

minimize  Zif  Xj  +  x2j  (14) 

such  that 


<£>(*,T2(*))>l-£,ifc=0...n-l. 


where  4>  is  given  by  (4). 

In  essence,  we  must  select  the  optimal  value  for  xt  such 
that  the  sum  of  Xi  and  EfxJ  is  minimized.  For  this  we  need  the 
discrete  probability  distribution  of  losing  k  responses,  Pt ,  which 
is  in  general  difficult  to  calculate.  As  this  example  is  no  excep¬ 
tion,  we  choose  to  approximate  this  system’s  distribution  by  the 
binomial  distribution.  (In  [17]  we  employ  a  better,  albeit  more 
sophisticated  approximation). 

The  binomial  approximation  says  that  a  response  overflows 
with  probability  that  is  independent  of  all  other  responses.  We 
made  a  similar  approximation  in  Section  2.3  where  we  bounded 
the  expected  number  of  losses  that  this  system  experiences.  The 
probability  p  that  a  given  responses  overflows  the  sender’s  buffer 
is  bounded  by  the  second  term  of  ((7)). 

*-<»-}> '• 


Since  only  N- 1  of  the  possible  N  responses  can  overflow,  the 
binomial  approximation  to  the  desired  Pt  is 


Pk(N- l,x„l)  = 


’N  - 1 
k 


pN-i-k(l_p)t  . 


In  Figure  7  we  constrast  this  approximation  with  the  distribution 
obtained  through  simulation.  It  lies  to  the  right  of  the  value 
obtained  by  simulation  because  (7)  is  an  upper  bound  on  the 
number  of  losses. 


If  the  sender  loses  k  responses  during  the  first  round,  then 
it  must  choose  x2  such  that  the  probability  <6  that  it  collects  the 
remaining  k  responses  during  the  second  round  exceeds  1  -  E. 
We  invert  (4)  and  obtain 


x2(*)  = 


1  -  (1  -  £)yt 
k  -  1 


We  can  now  calculate  EfxJ. 

E[T^=ipk^{k). 

*=o 


Probability 


Figure  7.  Probability  distribution,  U™ld/  1/1,  x=l,  service 
time  ji=.01.  The  approximation  is  shaded. 

of  the  total  latency,  E[x,  H-xJ.  In  Figure  8  we  plot  total  latency 
versus  the  choice  of  Xi.  When  is  much  smaller  than  optimal, 
the  expected  latency  approaches  the  latency  of  a  one  round  multi¬ 
cast  constrained  by  the  same  condition  that  4>  >  1  -  £.  When  X,  is 
much  larger  than  optimal,  the  expected  latency  approaches  xx. 
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Figure  8.  Total  latency  of  a  two  round  multicast  as  a  func¬ 
tion  of  the  first  round  timeout  X].  Ux/D  /l/l,  Service  time 
P  =  1.  One  round  multicasts  require  x  of  38,000  (£  =  1%), 
4,600  (E  =  5%),  and  3,600  (E  =  10%). 
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Applying  this  to  the  t/M/D/l/l  system,  we  examine  how 
the  choice  of  the  first  round  timeout  Xj  affects  the  expected  value 


5.  Conclusions 

Existing  methods  to  analyze  finite  buffer  systems  [2]  do 
not  apply  to  multicast;  while  the  overflow  analyses  presented  in 
this  paper  provide  insight  into  making  multicast  fast.  Single 
buffer  systems  treated  in  Section  2  yield  simple  expressions  for 
the  expected  number  and  distribution  of  losses.  Solving  these  sys¬ 
tems  leads  to  the  techniques  used  to  solve  multiple  buffer  systems. 
Overflow  of  multiple  buffers,  treated  in  Section  3,  is  frequently  a 
problem  of  multicast  in  distrubted  systems.  It  has  been  reported  in 
the  literature  as  back-to-back  packet  losses  of  Ethernet  interfaces, 
and  can  occur  within  the  layers  of  software  between  the  network 
interface  and  the  user  program.  The  backoff  algorithm  and  the 
timeout  selection  problem  presented  in  Section  4  minimize  the 
latency  of  reliable  multicast,  and  minimize  buffer  overflows 
regardless  of  whether  they  occur  at  the  network  interface  or 
between  user-system  software  boundaries  [8]  (recall  Figure  1). 

These  results  can  help  system  designers  optimize  multicast 
protocols,  decide  on  the  number  of  buffers  to  devote  to  a  multicast 
sender,  decide  the  cut  off  between  using  hardware  broadcast  and 
unicast  primitives,  and  choose  the  number  of  rounds  of  multicast 
They  place  selection  of  the  round  timeout  on  firm  mathematical 
ground.  Beyond  the  local  area  network,  these  techniques  apply 
overflow  at  network  gateways  caused  by  internet  multicast  [18] 
and  overflow  at  LAN  bridges  caused  by  extended  LAN  multicast. 

We  have  been  able  to  eliminate  several  of  the  unrealistic 
assumptions  mentioned  in  Section  1.1,  to  solve  the  Dynasty  prob¬ 
lem  exactly  for  one  buffer  systems,  and  to  calculate  many  of  the 
overflow  distributions  not  presented  in  this  paper.  In  the  furture, 
we  intend  to  implement  the  backoff  algorithm  efficiently  and 
determine  how  far  from  optimal  a  practical  implementation  must 
lie. 
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